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Abstract 

The original P M - (or D T -) energy spectrum from the gravitational collapse of a star has a larger average 
energy than the spectrum for v e since the opacity of v e exeeds that of ^(or v T ). Flavor neutrino conversion, 
v e Vp, induced by lepton mixing results in partial permutation of the original v e and spectra. An 
upper bound on the permutation factor, p < 0.35 (99% CL) is derived using the data from SN1987A and the 
different models of the neutrino burst. The relation between the permutation factor and the vacuum mixing 
angle is established, which leads to the upper bound on this angle. The excluded region, sin 2 29 > 0.7 — 0.9, 
covers the regions of large mixing angle solutions of the solar neutrino problem: "just-so" and, partly, MSW, 
as well as part of region of v e — oscillation space which could be responsible for the atmospheric muon 
neutrino deficit. These limits are sensitive to the predicted neutrino spectrum and can be strengthened as 
supernova models improve. 
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I. Introduction 

There are several hints that lepton mixing does exist and might even be much bigger than that in the 
quark sector. Solar neutrino data [1] can be reconciled with predictions of the Standard Solar Model [2] 
by long length vacuum oscillations ("just-so" solution) [3]. The required values of neutrino mixing angle, 
6, and masses squared difference, Am 2 , are: sin 2 29 = 0.85 - 1.0, Am 2 = (0.8 - 1.1) • lO" 10 cV 2 [4]. 
The solar neutrino problem can be solved also by resonant flavor conversion, the MSW-effect [5]. For the 
MSW solution, the data single out two regions of neutrino parameters, one of which involves large mixing 
angles: sin 2 29 = 0.6 - 0.9, at Am 2 = (10~ 7 - 10~ 5 ) eV 2 [6]. The deficit of the muon neutrinos in the 
atmospheric neutrino flux can be explained by — v e oscillations with parameters [7]: sin 2 29 — 0.5 — 0.9, 
Am 2 = (10- 3 - 10~ 2 ) cV 2 (see fig.3). 

On the other hand it has been argued that mixing in the lepton sector can be "naturally" large. In 
particular, large lepton mixing may appear in models with radiative generation of the neutrino masses (Zee- 
mechanism [8], see [9] for review). In the "see-saw" mechanism some configurations of mass matrices result in 
large mixing angles (see, e.g., [10]); the "see-saw" enhancement of lepton mixing may take place at definite 
conditions (strong mass hierarchy in Majorana mass sector, or definite symmetry of the majorana mass 
matrix and mass degeneration of the right-handed neutrino components [11]). 

Large lepton mixing can be generated by some interactions at the Planck scale, which result in non- 
renormalizable terms of the type (aij/Mpi) ■ lfljH + H [12,13]. Here k (i = e,[i, r) are the lepton doublets 
of definite flavor, H is the Higgs doublet, and Mpi is the Planck mass. At a m 1, these terms generate 
the neutrino masses = (H) 2 /Mpi w 10~ 5 cV, which gives Am 2 in the region of "just-so" solutions. 
Furthermore, it was argued in [13] that the "Planck-scale interaction" related to gravity does not respect 
lepton number, and moreover all coupling constants in the flavor basis have the same value — ao[13]. The 
corresponding mass matrix has all elements equal to each other. In this case, the electron neutrino mixes 
with only one state, namely, with the combination [y^ — v T )/\/2, and the mixing parameter is sin 2 29 = 8/9, 
i.e. precisely in the "just-so" region. Although there is no real model for the "Planck-scale interaction" the 
coincidence of parameters is remarkable. 

In this paper we will discuss the limits on large lepton mixing that could be obtained using the obser- 
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vational data from the supernova SN1987A [14, 15, 16]. 

The effects of lepton mixing on the neutrino fluxes from gravitational collapses of stars have been widely 
discussed [17 - 22, 5]. In particular, it was noted that large flavor mixing results in a significant distortion 
of the v e - spectra at the Earth; the appearance of a high-energy tail, and thus the increase of the average 
energy of the detected events relative to the no mixing case are expected [17, 19, 20]. Comparing the spectra 
with and without mixing effects it was remarked in [19] that Kamiokande data seem to disfavour 9 > 50°. 
At large mixing angles, the oscillations in the matter of the Earth result in different signals in Kamiokande 
and 1MB detectors; this could explain the more energetic spectrum seen by 1MB [20]. Here we refine the 
consideration of the large mixing effects to obtain statistically significant upper bounds on the mixing angle 
by make of use of the existing data from SN1987A. 

II. Permutation of v e and spectra. Permutation factor. 

Consider the influence of transitions P e <-> on the v e - energy spectrum. Since and D T have, to high 
accuracy, the same production and detection properties, the results will be the same for transitions to D T or 
to any combination of and v T . (This remark applies also for transitions into v„ and v T ). We will comment 
on three-neutrino mixing latter (in Sect. IV), although many cases can be reduced to two neutrino mixing. 

Let F (i> e ) and F^v^) be the original P e -, and v^- spectra, and let p be the probability of a v e — > 9^ 
transition on the way from a core of collapsing star to the detector. Since the 9 e -, and v^- spectra emitted 
by neutrinospheres are incoherent, the v e flux in the detector can be written as 

F{v e ) = (l-p)-F {v e ) +p-F (D lt ). (1) 

Obviously, there is no observable effect when the original spectra are the same: Fo(D e ) — Fo(P M ). 

The energy spectra of P e 's and D^s that are emitted from the core of a collapsing star are different: the 
D e - spectrum has a mean energy that is 1.5 - 2 times smaller than that of the P M - spectrum. This general 
feature follows from the fact that v e interacts with matter more strongly than does; neutral current 
scattering and charged current absorption on protons, v e + p — > n + e+, are allowed for 9 e but not for v^. 
Also, due to the charge current interaction, the cross-section of ^-scattering on electrons is larger than that 
for Dp. Therefore 9 e 's encounter a larger opacity and consequently are emitted from more external and colder 
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layers of the star. This essentially model-independent feature plays a key role in our determination of the 
maximum allowed mixing angles. Another crucial point is that the cross section of the detection reaction, 
v e + P — > e + + n, is approximately proportional to the neutrino energy squared. Therefore even a small 
permutation (or admixture of a higher energy spectrum) can result in an appreciable effect. 

The transformation factor, p, depends on the energy of the neutrino, the mass splitting, the vacuum 
mixing angle, and the density profiles of the supernova and the Earth. However, for most of the interesting 
mass range, p is independent of energy For Am 2 ~ 1CT 6 eV 2 , the energy dependence is important and 
we average the permutation factor over the energy distribution. If p = 1 (complete transformation), the 
detected v e - spectrum will coincide with the original spectrum: F(v e ) = Fo(P M ) and, vice versa, the final 
will coincide with original spectra of v e . The spectra permute and we will call the average probability p 
the permutation factor, lip < 1 , only partial permutation takes place and the final ^ e -energy spectrum will 
be a mixture of the two original v e and spectra. 

Fig.l depicts the expected cumulative energy spectrum of the events in Kamiokande-II and 1MB de- 
tectors for different values of p. The parameters of a "conventional neutrino burst" [23, 24, 25] have been 
used. As many authors have concluded previously, the observed energy spectrum from SN1987A is in rea- 
sonable agreement with that calculated without any neutrino transformations. Fig.l shows that the D e — > 
9^ transition produces unobserved high energy events. We use this result to exclude large values of p. 

III. Upper bounds on the permutation factor from SN1987A data 

We will compare the shapes of the predicted time-integrated energy spectra for different values of p 
with the observed energy distribution. The original P e -, and v^- spectra are approximated by the modified 
Fermi-Dirac spectrum [26 - 32]: 

dE tot _ AE 3 
dE ~ e (§-v) + i ' 

where A,T,t] are the fit parameters. The modification is related to the fact that the emitted spectra are 
superpositions of thermal fluxes (in general, Fermi-Dirac spectra with nonzero chemical potentials) from 
different thermalization spheres. These spectra are further modified by scattering and absorption above the 
thermalization spheres and by the integration over the neutrino burst time (the effective temperatures are 
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changed during the burst). Instead of T, we fix the average energy of the spectrum, E, : 



J^tot 



E = 



dE*"* dE ' 
dE E 



I 



where E tot = J 



dE to 
dE 



dE is the total emitted energy in a given neutrino type. The distortion parameter, 77, 



has the effect of a "chemical potential" . The parameters of the time-integrated spectra that we use in our 
analysis are: the average energies of the electron antineutrino, E e , and the muon antineutrino, E^, as well as 



carried away by neutrinos is eliminated by normalization; the total number of calculated events is constant 
and equal to the observed value, N = 20. 

The cumulative energy spectra of observed and calculated neutrino events are compared by the Kholmogorov-| 
Smirnov test, which allows us to set non-parametric upper limits on p at a definite confidence level for different 
values of the original spectra parameters (see fig. 2). As is apparent from fig. 2, the inferred upper bound 
depends most strongly on the average muon neutrino energy, E^; the main difference between the calculated 
and the observed spectra comes from the high energy region for which the calculated events are caused by 
i/fj, converted to v e . If E^ < 6.5 MeV, then the bound is p < 0.5 and no strong limit can be obtained for 
the antineutrino channel (see Sect. IV). The bounds depend weakly on the total fluence emitted in (fig. 
2a). For example, at — 22 MeV, one has p — 0.30, 0.34, and 0.39 for r = 1.2, 1.0, and 0.8 respectively. 
The bounds depend rather weakly (5% change) on E e in the most reliable region of values 12-15 MeV (fig. 
2b). At larger or smaller energies, the limits become artificially strong due to the general disagreement of 
the predictions and the data even without the permutation effect. The bounds are sensitive to the shape of 
the original spectra (fig. 2c). The more pinched the spectra (bigger 77), the stronger the suppression of the 
number of high energy events, and, consequently, the weaker the restrictions. For fixed E^, the dependence 
of bounds on 77 is stronger for smaller energies E^. At E^ = 22 MeV, the increase of r\ from (pure Fermi- 
Dirac spectra) to 3 results in the increase of p by 15%. There is a strong dependence of the inferred limits 
on the assumed value of the distortion parameter of the electron antineutrino spectrum, r\ e . A decrease of 
ij e results in an increase of the number of high-energy events induced by v^s and therefore strengthens the 
limit on p. The limits on p at different confidence levels are shown in fig. 2e. At 95% CL, a significant limit 
exists even for E^ = 17 - 18 MeV. At 99.9% CL, a significant limit can be established only for E^ > 22 — 23 



the ratio of the total energies emitted in f e 's and v^s: r = 




^4. The absolute value of the total energy 
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MeV. At the representative value of energy E^ > 22 — 24 MeV, the 2a- limit is 35 % stronger than 3a limit. 

Baksan data [16] could be included in the analysis. In the Kamiokandc and 1MB time interval, five events 
were detected at Baksan and some of these events could be related to the neutrino burst from SN1987A. 
To derive an upper bound including the Baksan data, one could use the two most energetic Baksan events: 
23 and 20 MeV (corresponding approximately to the expected number of events given the number of events 
observed in the bigger Kamiokande and 1MB detectors). This would strengthen the upper bound by of order 
ten percent. 

Since we use data from SN1987A, the model of collapse and therefore the integral characteristics of 
the neutrino burst can in principle be restricted further by using information on the progenitor and the 
observed properties of light curve of SN1987A. The available data suggest a mass of the iron core [26] 
Mp e = (1.3 — 1.6)M , and, consequently, a total energy carried away by neutrinos of E tot = (2 — 4) • 10 53 
ergs. The time interval of neutrino emission, At w 13 s, is in a good agreement with the expected value, 
further indicating the basic correctness of the conventional picture of neutrino transport. The observed 
neutrino energies versus time suggest that the average energy decreases with time, consistent with idea that 
neutrinos are emitted in the cooling stage. 

In Table I, the principal parameters of different models [24 - 32] of neutrino bursts which satisfy the above 
conditions are presented and the upper bounds on p are given in accordance with fig. 2. The restrictions: 



can be considered as upper bounds in a representative supernova neutrino burst model. 

One comment is in order. The difference between the P e -, and v^- spectra is determined by the difference 
in interactions as well as by the structure of the star, i.e. the density, temperature, and lepton-number 
profiles. The latter in turn depends on the nuclear equation of state (EOS). A soft EOS results in the 
creation of a hot and compact protoneutron star, whereas a stiff EOS produces a colder and more expanded 
central object with smaller temperatures and a smaller gradient of temperature [33]. As a result, one expects 
smaller energies of in the model with a stiff EOS. In [33], a very stiff EOS by Wolff [34] was used and the 
average energies E e w 12 MeV and — 14 MeV were obtained. This small difference in average energies 
probably indicates only the direction of a trend rather than a self consistent numerical result. Indeed, the 




99% , 
95% , 



(2) 
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model by Mayle and Wilson [24] at t = 0.4 s after the bounce was used as the initial condition. This model 
is based on a softer EOS, so that the the calculation described in [33] requires a non-physical change of the 
EOS at 0.4 s. The parameters at 0.4 s were adjusted to obtain the hydrostatic configuration, whereas in 
the original Mayle- Wilson model at t = 0.4 s the star is still in the dynamical phase. In [26], no strong 
difference of the properties of the neutrino burst were obtained between a soft and a stiff EOS. There is an 
additional reason for regarding the results of [33] with caution. The "flux-limited diffusion method" was 
used to describe the neutrino transport, and the v e -, v^- energy distributions obtained are appreciably wider 
than Fermi-Dirac spectra. In particular, the calculated v^- spectrum can be approximated by a Maxwcll- 
Boltzmann distribution [r\ — > — oo). These features [33] are in contradiction with other results obtained by 
the same method [26 - 30] , as well as with results of a physically more correct method based on Monte-Carlo 
simulations [31, 32]. It is of great importance to calculate a self-consistent supernova model with the same 
stiff EOS [34] at all stages and to check whether such a model fits the SN1987A data (including the neutrino 
luminosities and the duration of the neutrino burst). 



IV. Permutation factors and lepton mixing. 

We consider in this section the propagation of neutrinos from the core of a star to detectors on Earth 
and determine the relations between the permutation factor, p, and the vacuum mixing angle, 9. We assume 
for most of this section that the admixture to v e and v e of the light mass component is larger than that of 
the heavy component. In this case, the v e <-» channel is nonresonant. (Matter resonance takes place in 
the neutrino channel, v e <-> v^, as it is implied by the MSW solution to the z/ Q -problem. We will comment 
on the opposite case at the end of this section.) 

For the nonresonant channel, v e -v^ the mixing angle in matter, 6 m , is always smaller than the angle 



m vacuum: 



tan 2 29 

Sm 29m = (^ + l) 2 +tan 2 2fl ' (3) 
Here p is the density, to at is the nucleon mass, and 



toatAto 2 cos2# 

PR = 2V2G F Y e E (4) 
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is the resonant density for the neutrino channel (Gf is the Fermi constant, Y e is the number of electrons per 
nucleon). 

For values of neutrino parameters of interest, i.e., Am 2 <; 10~ 2 cV 2 , E ^ 10 MeV, the resonant density, 
Pr ^ 10 4 g/cm 3 , is much smaller than the density at the neutrino production point, p — 10 12 g/cm 3 . 
Therefore the initial mixing is strongly suppressed: sin 29° m w tan 2 29 • (^) and the initial neutrino 
state practically coincides with eigenstate of the instantaneous Hamiltonian of the neutrino system, v\ m ,\ 
P(t = 0) = & e = v\ m . Further evolution of this state is determined by the adiabaticity condition [5]. (If 
this condition is fulfilled, the transitions of the eigenstates, v\ m <-» z?2m, can be neglected). The adiabaticity 
condition reads: k <C 1, where k = dB ™^ r i s the adiabaticity parameter [5]. Here AH is the energy 
splitting between eigenvalues of the Hamiltonian, AH = E(D\ m ) — Efom)- The adiabaticity parameter can 
be written in the following form: 



sin 3 20 m ll 



K 



(5) 



sin 2 29 4tt l p ■ l ' 

where l v = AirE/ Am 2 is the oscillation length in vacuum, l = 2-kitin I 'V^G 'p pY e is the refraction length, 
and l p = p/(dp/dr) is the typical density scale height. 

Since sin 3 20 m oc 1/p 3 at p 3> pr and l^ 1 oc p, the parameter k is small at large densities, and the 
adiabaticity condition is fulfilled in the early stage of neutrino propagation. When the density decreases, k 



first increases as 1/ p 2 1 reaches a maximum value at p m <~ pR (p m /PR = | V — j, where y = y 1 + | tan 2 29), 
and then decreases again as p. For p = p m we get from (5): 

where 



f(0) = 



16 tan 2 29 y-\ 



9 sin 29 [( y + 1)2 + M tan 2 20] * ' 
The function f(9) increases from w 0.09 at sin 2 29 = 0.3, to w 0.28 at sin 2 20 = 0.95; (/ = 2 at sin 2 29 = 1). 

Substituting a typical value f{9) = 0.2 into (6), we find 



-<-^-"(^)(lo^v)(^)- 

For l p = Rq one obtains from (7) that kr = 1 (strong adiabaticity violation at resonance densities) at 

. 2 f 6 ■ 10- 10 eV 2 (E - 10 MeV) ... 

Am ° ~ \3-10- 9 eV 2 (E = 50 MeV) ' (8j 



Note that l p may change from 0.1 Rq in the region of large densities, p <~ 10 4 g/cm 3 , to (3 — 4) • i? Q at small 
densities, p <~ 10~ 4 g/cm 3 [35]. 

The mass Am 2 defines two extreme cases. Adiabatic case: Am 2 » Am 2 ,; the adiabaticity condition 
is fulfilled everywhere in the star. Nonadiabatic case: Am 2 <C Am 2 . Here the adiabaticity is strongly 
broken in the region around pa, where the mixing angle varies from 6 m ~ to 9 m ~ 9. As we will see, 
the dynamics of propagation in these extreme cases is simple and the results are essentially independent of 
the density distribution in the star. Moreover the permutation factor is practically independent of neutrino 
energy. Fortunately, the Am 2 regions of interest fit these two extreme cases. The atmospheric neutrino 
region as well as large mixing MSW-solutions are in the adiabatic domain; the "just-so" solution lies in the 
nonadiabatic domain. 

1). In the adiabatic case the neutrino state which is produced as v e = D lm , will everywhere practically 
coincide with v lm since there are no v\ m <-» D 2m transitions. So the neutrino leaves the star as v lm (p = 0), 
which is the state with definite mass v\ . No oscillations will take place on the way from the star to the Earth 
and the neutrino state arriving at the Earth will be v\. Consequently, the probability of v e —*Vy, transition 
(permutation factor) in this case equals p a — Kz^JPi)! 2 = sin 2 9 (see also [19]). 

In the region of mass squared difference Am 2 = (10~ 4 — 10~ 7 ) eV 2 , the permutation factor must be 
corrected for the effect of neutrino oscillations inside the Earth. Neutrino trajectories from SN1987A to 
terrestrial detectors lie in the mantle of the Earth, where the density changes rather slowly. Therefore, 
to a good approximation, one can consider the Earth-matter effect as neutrino oscillations in matter with 
constant density (pimb — 4.6 g/cm 3 for 1MB and px — 3.4 g/cm 3 for Kamiokande-II). Neutrinos arrive at 
the Earth as two incoherent beams: v\ - flux with energy spectrum F {v e ) and v 2 with energy spectrum 
Fo(V[_i)- Considering then the v\ — v 2 oscillations in the matter of the Earth, one finds the permutation factor 



p a = sin 2 6 - sin 26 m ■ sin 2(0 - 6 m ) ■ sin 2 ^ , (9) 



where 9 m — 9 m (pi, E/Am 2 , 9) (i = 1MB or K) is the mixing angle in the matter of the Earth, x is the length 
of the neutrino trajectory inside the Earth (xk = 3.9 • 10 8 cm, ximb = 8.4 • 10 s cm for Kamiokande and 
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1MB detectors respectively), and 

i 

2 

(10) 

is the oscillation length in matter. Here p R — p R (p i7 E/Am 2 7 9) is defined in Eq.(4), Y e w 0.5. The first 
term in the right hand side of Eq.(9) corresponds to the adiabatic result without the Earth effect. The 
second term is the Earth correction. Since for the nonresonant channel 9 > 8 m , this second term is always 
negative. Therefore, the Earth matter effect weakens the permutation and relaxes the restriction on mixing. 
The oscillation length is always smaller than the refraction length. Moreover, at small -j^p (kig Am 2 ), the 
oscillation length is much smaller than Iq. 

The second term in (9) is an oscillating function of x as well as E/Am 2 . The amplitude of the oscillations, 
sin 29 m • sin 2{9 m ), reaches the maximal value, sin 2 6, at 9 m = 8/2. If at this point one has x/l m = it ■ n 
(n is integer), then the Earth effect completely compensates the effect in the star and p a = 0. The condition 
for the amplitude of the correction to be a maximum, which can be written as pr(E/ Am 2 ) = p ■ cos 29 
, defines the Am 2 -region of strong Earth matter effect. Taking into account that the interval of neutrino 
energies of interest is 10 - 50 MeV, we obtain that this region extends over three orders of magnitude around 
Am 2 w 10 -5 eV 2 : Am 2 = (10~ 7 - 10~ 4 ) cV 2 . At p R > p ■ cos 29 and p R < p ■ cos26>, the matter mixing 
angle is respectively w 9 or w and therefore the correction is negligibly small. 

In the region Am 2 > 10~ 5 eV 2 , the correction is a rapidly oscillating function of the neutrino energy. 
One can average over these oscillations, by integrating over the neutrino distribution function to yield an 
average p, which is used in Figure 3. Here 9 rn = 9 m (Am 2 ,E,p), where E — (E e + E^)/2 w 20 MeV and 
p = (pK + Pimb)/2 w 4.0 g/cm 3 . At Am 2 < 10~ 5 cV 2 , the approximation p w constant is not valid 
and one must compare directly the observed distribution and the predicted one with an energy-dependent 
oscillation factor. In this case the Earth effect strongly depends on neutrino energy and is different for 
different detectors. One can use this feature to explain some difference in the energy distributions of the 
Kamiokande and the 1MB signals [20] . Fig. 4 depicts the upper bounds on sin 2 29 obtained with neutrino 
spectra from [25]. 

2). Nonadiabatic case. If k 3> 1, neutrinos propagate nonadiabatically in the region of strong change 
of the mixing angle (p ~ p R ). The adiabaticity starts to be broken at p » pr, where the mixing is rather 
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to • 



I PR_ \ 2 , ( PR ^ ~ 



^) tan 2 29 
P 



small, 6 m w 0. As the first approximation, one can neglect the change of 9 m in the initial adiabatic stage 
counting 9 m = 0, and consider just the vacuum oscillations of 9 e in the star and on the way from the star to 
the Earth. In this case, the permutation factor coincides with the "vacuum" permutation factor: 

Pna ~ Pvac = ^ Sm 2 29 . (11) 

Consider the effect of the adiabatic transformation of the neutrinos in the initial stage. Let p a be the density 
at which n = 1 (see Eq.(5)). Then, the neutrino flavor changes adiabatically at p ^> p a ; in the region p <~ p a , 
flavor changes nonadiabatically, and at p <C p a , where n >• 1, one can consider just vacuum oscillations. 
Even if the adiabaticity is restored at p <C pr, the matter effect in this region (especially at big mixings) is 
negligibly small. To estimate the effect of adiabatic and nonadiabatic conversion, one can (simplifying the 
picture) consider the propagation before p a (p > p a ) as pure adiabatic and after p a (p < p a ) as strongly 
nonadiabatic, i.e. as oscillations in vacuum. If 9 a is the mixing angle at p a : 9 a = 9 m (p a ), then the neutrino 
state which adiabatically arrives at p a can be written as v a w v\ m = cos9 a ■ v e — sin0 a • v^. Considering 
vacuum oscillations of v a in the region p < p a , as well as on the way from the star to the Earth, one gets 

Pna = \ [1 - cos 2(9 - 9 a ) ■ cos 29} . (12) 

The Earth matter effect in the nonadiabatic domain (Am 2 < 10~ 9 cV 2 ) can be neglected due to strong 
suppression of mixing. In the limits of very strong adiabaticity violation (p a 3> pr and 9 a =0), Eq.(12) 
reduces to the pure vacuum oscillation result (11). In the opposite case, when the adiabaticity condition 
is satisfied everywhere up to zero densities (9 a = 9), Eq.(12) reproduces the pure adiabatic permutation 
factor. At p a ^> Pr, the condition for 9 a can be written as (see Eq.(5)): 

sin 2 2(9 a w 47rsin26» • l f. (13) 

In the region of the "just-so" solution, kr w 5, i.e. the adiabaticity condition is strongly violated. Using 
Eqs.(12, 13), one finds that at l p = (1 — 3)Rq and E > 20 MeV the permutation factor decreases by (3 — 5)% 
in comparison with the vacuum value. The dependence of the correction on energy is very weak. 

According to Eqs. (9 - 12), the adiabatic permutation factor is always smaller than the nonadiabatic 
and the vacuum (or strongly nonadiabatic) permutation factors: p a < p na < p vac - Note that in the 
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nonresonant case the nonadiabatic transition results in a stronger effect than the adiabatic transition. The 
adiabatic permutation factor can be used to obtain the lower limit of the permutation effect. 

Using the relations in Eqs.(9, 11) we find the upper limits on sin 2 26 corresponding to different upper 
bounds on p. In the extreme cases: 

sin 2 20 < { ^ ^ _ ^ (adiabatic, without Earth effect) 
~ \ 2p (strongly nonadiabatic) 

For the upper bounds given in equation (2), we get the following upper limits on mixing angle at 99% CL: 

. 2 „ fl f0.9 (Am 2 » l(T 9 cV 2 ) , . 

Sm W M0.7 (Am 2 « lO^eY 2 ) (15) 

These results are exhibited in Figure 3. 

In the case of three neutrino mixing, the permutation factor is determined by the elements of the mixing 
matrix U e i (i = 1, 2, 3): p a = 1 — \U e i\ 2 in the adiabatic limit, and p na = 1 — J2i=i 2 3 Wei\ A m the strongly 
nonadiabatic limit. 

For the resonant channel (neutrino transitions v e — v^, or antineutrino transitions in the case of inverse 
mass hierarchy), the permutation factor can be found from the result obtained above: p r ^ s = 1 — p a . Now 
Pa es = cos2 ^ without Earth matter effects and the Earth decreases again the transition, because now m > 8 
(see Eq.(9)). In vacuum, p r ^ c = p vac , if there is no CP-violation. For the resonant channel, the relation 
between different permutation factors reads: p a > p na > Pvac- 



V. Discussion 

1. We have obtained an upper bound on the permutation parameter, p, (see Eq.(2)) using observational 
data on the neutrino burst from SN1987A and the original neutrino spectra predicted by neutrino burst 
models that describe well the observed luminosity and the burst duration. We have derived the relation 
between the permutation factor and the vacuum mixing angle and have shown that this relation is practically 
independent of the structure of the star in physically interesting regions of neutrino parameter space. The 
relation allows one to set upper bounds on the lepton mixing angle (see Fig. 3). The excluded region of 
neutrino parameters covers the region of the "just-so" solution of the solar neutrino problem, part of the 
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region of the large-mixing-angle MSW solution, and part of the region of v e — oscillations which could be 
responsible for atmospheric muon neutrino deficit. 

2. The upper limit on p derived here can be directly applied to any transformations of v e to v^, or u^, or 
v T , or y T which are independent of, or only weakly depend on, the neutrino energy. Spin- flavor conversion, 
v e R v^l (or v T ), can result in spectra permutation with p up to 1/2. This maximal value could be realized 
if there is some region inside the star in which the the interaction with magnetic field, B, dominates over the 
vacuum and the matter effects: \i ■ B ^> GFp/rriN, Am 2 /E, and the neutrino propagates up to this region 
adiabatically. The limit on p set in this paper can be converted to a limit on the product \x- B(r), although 
this restriction depends sensitively on the structure of the star. 

If neutrino mixing is induced by some flavor off-diagonal interaction with the ambient medium ( "massless 
oscillations") [36], then both neutrino and antineutrino channels can be resonant. In this case p may be 
bigger than 1/2 [37]. The upper bound set here on p translates into the upper bounds on the coupling 
constants of the new interaction [37]. 

3. The upper bounds on p, and therefore on lepton mixing, depend strongly on the parameters of the 
original neutrino spectra (Fig. 2). The integral characteristics of the neutrino burst (such as total energies 
emitted in neutrinos, or the average energy of time integrated spectra) are determined in large part by 
the initial mass of iron core, Mp e , and are independent of most details of the model or of the explosion 
mechanism [25]. Since Mp e and the duration of the neutrino burst are fixed by observations, the integral 
parameters of the neutrino burst can, in principle, be strongly constrained. The difference in fluxes and 
the average energies of neutrinos of different species are determined by the known difference in interactions 
of these neutrinos. Moreover, the effective temperatures of neutrino spectra enter as T 4 in the luminosity 
and as T 5 in the interaction rates. This means that small changes in T imply appreciable changes of other 
characteristics of the supernova; this circumstance is reflected in the relatively small spread of calculated 
model parameters (see Table I). 

It is of great importance that supernova modelers refine their predictions for integral characteristics of 
neutrino energy spectra. One needs to find the reliable regions, as well as the allowed limits, for parameters 
characterizing the energy spectra by making use of all available information on SN1987A (excluding, of 
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course, the information on the neutrino burst). 

4. Future observations of SN1987A (light curve, possible manifestations of remnant), when combined 
with improvements in the theory of neutrino transport and supernova explosion may allow one to make 
stronger inferences. The detection of a new (high-statistics) neutrino burst would make it possible to look for 
the deviations from simple Fermi-Dirac spectra modified by a "chemical potential," especially the appearance 
of a high-energy tail. Confronting the model calculations with data on both the charged current and on the 
neutral current interactions (as is possible with SNO, LVD, Superkamiokande) would sharpen the conclusions. 

5. We have described in this paper a method of constraining lepton mixing using data on a neutrino 
burst produced by gravitational collapse. Depending on the skepticism of the reader, the results obtained 
from SN1987A can be considered as either a demonstration of the method or as indicating that large-angle 
lepton mixing is excluded. 
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Figure Captions 

Figure 1. The cumulative energy spectrum of the events in the Kamiokande and 1MB detectors predicted 
for different values of permutation factor p (from left to right: p = 0, 0.1, 0.2, 0.3, 0.4 and 0.5). Original 
spectra were taken according to the model [24] . Histogram shows the detected spectrum. 
Figure 2. Upper bounds on permutation factor from SN1987A data as functions of the original spectra 
parameters, a). The dependence of the upper bound (99% CL) as a function of the average muon energy 
on the ratio of total energies, r, emitted in and D e . Other parameters are fixed as follows: E e = 13 
MeV, r)e=f)ix = 2. Top to bottom: r = 0.4, 0.6, 0.8, 1.0, 1.2. b). The dependence of the same bound as in 
a) on the electron antineutrino energy, E e . Other parameters: r = 1, r] e = = 2. Top to bottom: E e = 12, 
10, 13, 14, 16 MeV. c). The dependence of the same bound as in a) on the spectrum distortion parameter 
i]^. Top to bottom: n^ = 0, 1, 2, 3, 4. Other parameters: E e = 13 MeV, r = 1, n e = 2. d). The same 
dependence as in c) for rj e — 0. Top to bottom: n^ = 0, 1, 2, 3, 4. c). The upper bound on p at different 
confidence levels. Top to bottom: p = 99.9%, 99.5%, 99%, 98%, 95%. 

Figure 3. (a) The excluded regions of the neutrino parameters for different upper bounds on permutation 
factor (figures at the curves). In the region Am 2 = (10~ 8 — 10~ 9 ) eV 2 the restrictions (shown by dashed 
lines) may appreciably depend on density distribution in the star. In the region Am 2 = (10 -5 — 10~ 6 ) eV 2 
the approximation p — constant does not work due to Earth matter effect (dotted lines) . Also the regions 
of the solar neutrino problem solutions by the MSW effect and "just-so" oscillation, as well as the region 
responsible for atmospheric muon neutrino deficit are shown. Shadowed curve depicts the upper bound on 
neutrino parameters from the reactor oscillation experiments, (b) This figure shows the excluded region as 
a function of < p >, where < p > is averaged over the electron distribution function. The contours are for 
< p > = 0.05, 0.1, 0.15, 0.2, 0.25, 0.3, 0.35 and 0.4. 

Figure 4. The upper bounds on the mixing angle in the region of a strong Earth effect. The curves are 
shown for 95% and 99% CL. The original spectra by MWS [25] are used. 
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Table 1. Integral characteristics of the neutrino bursts in different models and corresponding upper bounds 
on permutation parameters. (MWS - [24], Bruenn - [26], Burrows - [28 - 30], Janka - [31, 32]). 



Model 


E e , 


E l i 1 


r 


Ve 


In 


P, 


P, 




MeV 


MeV 








95% CL 


99% CL 


MWS 


13.8 


22.3 


0.9 


3.8 


0.6 


0.27 


0.42 


Bruenn 


13 


25 


0.8 


2 


3 


0.18 


0.27 


Bruenn 


13 


25 


0.8 


2 


2 


0.17 


0.26 


Burrows 


11.1 


21 


1.0 


0.8 


2 


0.24 


0.38 


Janka 


14 


22 


0.8 


2 


2 


0.23 


0.35 
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